intrinsic dimension
Country:
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Europe > Denmark (0.04)
Technology:
Country:
- Oceania > Australia > New South Wales > Sydney (0.04)
- North America > United States > Maryland > Prince George's County > College Park (0.04)
- Asia > China > Liaoning Province (0.04)
Technology:
The geometry of hidden representations of large transformer models
By analyzing the intrinsic dimension (ID) and neighbor composition, we find that the representations evolve similarly in transformers trained on protein language tasks and image reconstruction tasks.
Country:
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Europe > Italy > Friuli Venezia Giulia > Trieste Province > Trieste (0.05)
- Europe > Italy > Tuscany > Florence (0.04)
- Asia > Taiwan > Taiwan Province > Taipei (0.04)
Technology:
Intrinsic dimension of data representations in deep neural networks
Alessio Ansuini, Alessandro Laio, Jakob H. Macke, Davide Zoccolan
Neural Information Processing Systems http://nips.cc/
Country:
- North America > Canada (0.04)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.84)
Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
When training deep neural networks, a model's generalization error is often observed to follow a power scaling law dependent both on the model size and the
Country:
- North America > United States > Georgia > Fulton County > Atlanta (0.04)
- Asia > Middle East > Jordan (0.04)
Technology:
PAC-Bayes Tree: weighted subtrees with guarantees
Neural Information Processing Systems http://nips.cc/
Country:
- Asia > Japan > Honshū > Kansai > Kyoto Prefecture > Kyoto (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > Canada > Quebec > Montreal (0.04)
Country:
- North America > United States > California > Alameda County > Berkeley (0.04)
- Europe > Russia (0.04)
- Asia > Russia (0.04)
- (4 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Country:
- North America > United States > California > Alameda County > Berkeley (0.04)
- Europe > Russia (0.04)
- Asia > Russia (0.04)
- (3 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Efficient Sketches for Training Data Attribution and Studying the Loss Landscape
These limitations, both theoretical and practical, underscore the need for novel sketching algorithms.
Country:
- North America > Dominican Republic (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Europe > Netherlands > North Holland > Amsterdam (0.04)
- Africa > Middle East > Tunisia > Ben Arous Governorate > Ben Arous (0.04)
Genre:
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.67)
Technology:
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Data Science (0.92)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
